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Abstract 

We consider an Ornstein-Uhleneck (OU) process associated to self- 
normalised sums in i.i.d. symmetric random variables from the domain 
of attraction of A^(0, 1) distribution. We proved the self-normalised 
sums converge to the OU process (in C[0,oo)). Importance of this is 
that the OU process is a stationary process as opposed to the Brow- 
nian motion, which is a non-stationary distribution (see for example, 
the invariance principle proved by Csorgo et al (2003, Ann Probab) 
for self- normalised sums that converges to Brownian motion). The 
proof uses recursive equations similar to those that arise in the area 
of stochastic approximation and it shows (through examples) that one 
can simulate any functionals of any segment of the OU process. The 
similar things can be done for any diffusion process as well. 
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1 Introducton 



Self-normalized sums have been studied in the literature, specially for sta- 
tistical estimation when one doesn't know the variance. For the history of 
the limit theory and for the problems one faces in the case of stable distribu- 
tions, an excellent source is Logan et al. [5]. Later authors have investigated 
various probabilistic aspects, like the Berry-Esseen bounds, the law of the 
iterated logarithm, large and moderate deviations etc. Another important 
question has been the necessary and sufficient conditions for the limiting 
distribution to be normal, see Gine et al. 

Recently Csorgo et al. [5] and Rackauskas and Suquet [B] have studied 
Donsker's theorem for self-normalized partial sums processes in zero mean 
i.i.d. random variables from the domain of attraction of the normal distribu- 
tion (DAN). Thus study of self- normalized sums and related processes and 
their functionals is an important area of research. In this article we consider 
an Ornstein-Uhlenbeck process associated to self-normalized sums in i.i.d. 
symmetric random variables from DAN. The process arises quite naturally 
(see (jl])) as the limit of an approximating sequence of processes involving self- 
normalized sums. Compared to Csorgo et al. [3] who obtain a nonstationary 
process (i.e. Brownian motion), we obtain a stationary process. This however 
does not make the proofs more involved, in fact apart from two references 
to Gine et al. our proofs are quite simple. The techniques may also be 
useful in studying similar stationary processes associated to self-normalized 
sums when the i.i.d. symmetric random variables come from other domains 
of attraction. 

The paper is organised as follows. In section 2 we give the construction 
and state the main result, theorem 12.11 Section 3 deals with applications. 
The proofs are given in section 4. The interesting part is the simple proof 
of tightness, which uses a recursive equation similar to those that arise in 
stochastic approximation. In the concluding section 5 we mention a related 
problem involving stable distributions. 

2 Notations and the main result 

Suppose {Xi}'^ is a sequence of i.i.d. symmetric random variables from the 
domain of attraction of A^(0, 1). The self-normalized sums Yj are defined as 
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follows: 
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(under conditions that the denominator is not 0, i.e. Xf ^ 0, with probability 
1). The partial sums process related to the above sequence studied by Csorgo 
et al. |3] is defined as 

whose convergence to the Wiener process is part of their results. 
In contrast we want to employ the self-normalized sum sequence more di- 
rectly. Let us fix some notational conventions first. Integer subscripts will 
denote random variables, integer superscripts will denote processes, processes 
with real numbers in first brackets will denote the processes at the indicated 
times. With this convention following Basak et al. [Ij, first we define the 
stochastic processes as follows: F"(0) = y„, 

I 

y"( h]) = Yu / > n + 1, (1) 



j=n+l 



where 6^,;^ = i?(T^) = l/(j + 1). At intermediate points the process is 
obtained by joining the nearest points linearly 

What the above does will be clear if at this point the reader looks at equation 
(jlj) in section 4, which will also explain what stationary limit one can expect. 
For the convenience of the reader and for the examples to be studied in the 
next section, we repeat some of it here. Since max{/c : JTT — ~ [ne*], 
the limiting behaviour of V^if)^ following ([1]), can be seen to be given by the 
limiting behaviour of 

>lne*] = 77 , (2) 

v/[ne«] 

for t > 0. However, to state the weak convergence result we have to be more 
precise. 

Our main result is about the weak limit of the sequence F", and is stated as 
follows: 

Theorem 2.1 Y"^ converges weakly in C[0, 1] to the stationary Ornstein- 
Uhlenbeck process with covariance function e~ 2 
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The technique for estabhshing this is through Prohorov's theorem, i.e. show- 
ing convergence of finite dimensional distributions and then proving tight- 
ness. This is done in the section 4. 

Weak convergence in C[0, oo) also follows from weak convergence in C[0,T], 
the proof is similar to that of theorem 2.1 for each T. Then one can study 
other functionals of the sequence Y"- through the same functionals of the 
Ornstein-Uhlenbeck process. As another application, one can consider the 
connection between and Brownian motion. This shows that the 

process {VtV^ilogt) : t > 1} converges weakly to Brownian motion {B{t) : 
t > 1}, and one can use Brownian functionals to study functionals of this 
process and vice-versa. Applications of these are considered in the next 
section. 

3 Applications 

We now present a few examples connecting functionals of Ornstein-Uhlenbeck 
processes with those of self-normalized random walks where we can apply our 
result. This would also indicate the differences between our result and the 
invariance principle presented in Csorgo et al [3]. 

Example 1. For any fixed, < s <t, 

(a) max Yi — )■ max Y{u) in distribution as m — )■ oo, 

[me*]<i<[me*] s<u<t 

and 

(b) min Yi — )■ min Y{u) in distribution as m — )■ oo, 

[me'']<i<[me^] s<u<t 

where Y^ = ^ Y(-) is a stationary Ornstein-Uhlenbeck process with 
parameter (—1/2, 1), i.e., it satisfies the stochastic differential equation, 

dY{u) = aY{u)du + adB[u), with a = —(1/2), cr = 1, 

and {B{-)} is a standard Brownian motion independent of Y{0), and Y{0) 
has A^(0, 1) distribution. 

Example 2. For any fixed, < s <t, 
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[me*] 


[me'^] 


1 




[me*] 


[me*] 


1 




[me*] — 


[me*] 



Yi Y{u)du in distribution as m — )■ oo, 



[me''] <j< [me'] 

(b) fZrrr l^^l y |^(w)|c?m in distribution as m —)■ oo, 

[me^]<j<[me*] * 

and 

1 r 

c) 7 — F r > ^ I (Y(u))'^du in distribution as m — )■ oo, 

^ me* - me* ^ 

^ i ^ i [me=]<i<[me*] * 

where {y('u)} is a stationary Ornstein-Uhlenbeck process with parameter 
(—1/2, 1), as above. 

The above examples can be seen in contrast with the invariance principle 
presented in Csorgo et al [3] as follows: 

Example 1'. For any fixed < t. 



and 



S- 

(a) max — y max B(u) in distribution as m — )■ oo, 

l<i<[met] V\met] 0<u<l 



(b) min )■ min B(u) in distribution as m — )■ oo, 

l<i<[met] V[met] 0<u<l 



where {B{-)} is a standard Brownian motion. 
Example 2'. For any fixed <t, 



[a) - — — > [ B{u)du in distribution as m — )■ oo, 

Re* V^me'] io 

l<«<[me'J ^ ^ 

(b) - — — y — ^- v / \B{u)\du in distribution as m —)■ oo. 



l<i<[me*] 

and 



(c) - — — y ( — —) — > / {B{u)Ydu in distribution as m oo, 

l<j<[me'J ^ ^ 

where is a standard Brownian motion. 
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4 Proofs 



Proof of theorem 12.11 

To show that converges to Y we show convergence of finite dimensional 
distributions and tightness of . We state these as two propositions. 
In the proof of convergence of finite dimensional distributions and their iden- 
tification we use Lemma 3.2 of Gine et al. |1] which adapted to our context 
reads as: for some slowly varying function l{n) we have 

^" ^ iV(0,l), 



\/nl{n) 



—J- 1 in probability (Gine et al. ^) . (3) 

Gine et al. |4j have stated their lemma for the infinite variance case. In the 
case of finite variance we can take l{n) = EX^,yn, and CLT and SLLN gives 
the same result. In the following proposition we make no distinction between 
the finite and infinite variance case. 

Proposition 4.1 The finite dimensional distributions ofY"- converge to those 
of a stationary Ornstein-Uhlenbeck process with covariance function e^al*"''!. 



Proof: Since max{k : Ylt J+T — ~ [ne^], we are interested in the limiting 
distribution of 

(^[ne'i], ■ ■ ■ , Ylne'k]) (4) 

for < ti < • ■ ■ < tfc (the above in the case of finite variance is clearly similar 
to 

*S'[ne'i] ^[ne^k] 
■ ■ ■ , 



and this motivates the limiting distribution). It is clear that by independence, 
and by the slowly varying nature of l{n) 



\ne 



converges in distribution to a vector of i.i.d. A^(0, 1), and also that 
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converges in probability to 



ioi i <k (this can be seen by writing 

^[L*i] = ^ne*i] + y^(^fne*n ~ ^[ne*i-l])' 
2 

and then using independence after dividing by a V|^gtr] — V|^gt^_ij where 1 < 
r < i). Hence, writing 



and using Slutsky's theorem, the hmiting distribution of 

5 

is seen to be multivariate normal with covariance between the limits of tt^ 



S tj 

and y ' (taking i < j) being 

[ne*i ] 



m=2 



completing the proof. □ 

In the proof of tightness we need the following two auxiliary results. The 
first one is part of theorem 3.3 from Gine et al. |1] stated in a form suitable 
for our purpose. 

Lemma 4.1 ( Gine et al. J^) For X in DAN with EX = 0, we have 



E 



V^.J 'J + V 

□ 
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The other result is a simple calculation and we state it as a lemma: 
Lemma 4.2 For j < k we have 



Proof: We write V^^^ = Vf^^ + Vl_^ where = E?=i2^*'- We then 



have, using the i.i.d. nature of X's and the symmetry of the expressions, 



from which the result follows. □ 
Now we prove 

Proposition 4.2 The sequence of stochastic processes Y"' is tight. 

Proof: From results in the literature (or ([3])) F"(0) = Yn is tight (converges 
to A^(0, 1)). Thus, by the corollary to theorem 7.4 of Billingsley ([2j) we only 
need to show that Ve, Vr], 3no and < S < 1 such that 



>- t<s<t+5 J 

In our problem it suffices to show that Ve, Vr/, 3nQ and < 5 < 1 such that 




1 





sup 




1 



1 



< 6 ^ P\ sup \Yk 



Yn\ > e ^ < r]^, > 77-0. 



n + 1 



+ ■■■ + 



/ + 1 



n<k<l+l 



Note that l^'s satisfy the following recursion: 
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Hence 



and 



fc-i 



\Yk-Yn\<Y, 



k-l 



n<k<l+l 

We thus have 



n<k<l 



(5) 



V n<k<l I ' Vi4-1 / 



~n<k<l 



(6) 



Inside the absolute values of the second term of ([6]) we have a martingale se- 
quence because the distributions of the X's are symmetric about and we can 
apply Doob's maximal inequality for submartingales (and then Burkholder's 
inequality) to get for an appropriate constant C4, 



^ n<k<l I Vj+l J 

— — n ■' 



u + m+i) 



(7) 



j,k = n 

where we have used lemmas 14.11 and 14.21 and we have written 



E 
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Recalling from lemma 14.11 that Oj+i — t- we have from 

k -j^ 

-^7 + 1 



n<k<l I V-'J-l J 



< Ca — < max a,- II > 

- I n<j<l M + ^ ? + 1 1 V ^ ? + 1 

. ^ 7 + 1 



max 

n<j<l 



J + 1 



^7 + 1 



(8) 



the first part of which can be made smaller than rj by choosing large and 
5 small remembering < 5. 

To the first term of ([6]) we shall apply Markov's inequality with second mo- 
ment. The Xj's being symmetric the distributions remain same if we replace 
them by e^Xj where e^'s are i.i.d. Rademacher random variables independent 
of Xj's. Thus distributionally \Yj\ equals 

\eiXi + --- + tjXj\ 



Now the first term of 



pj gives 

I 

WE 



(9) 



\Y,\>e 



/2} 



< 



X 



Xf 



i{E-(t;lv^ 



1/2 T/2 



+ E ^5 

i,k = n 

Remembering the expression ^ taking conditional expectation given 
{Xi, ■ ■ ■ we get 



(10) 



E 



^1, 



E 



X 



(11) 



10 



and supposing j < k applying conditional Cauchy inequality given 
{Xi, ■ ■ ■ ,Xfc+i} we get 



El -J-L±-^E YA 



Xu---,X,^,)\<E{-^-±tl). (12) 



Now combining fill I) and (1121) for (llOp we have as before 



s |{„"!??,h«-jiTl + (t-^)}(E-^)' (") 

(IHj) and ( fT3l) combined for ([6]) give us the required tightness. □ 
Using propositions 14. II and 14.21 the proof of theorem 12.11 is complete. 

5 Concluding remarks 

In the case of symmetric a-stable distributions (or symmetric distributions 
from the domain of attraction of symmetric a-stable distributions) it is known 
from Logan et al. |5] that 

Xf + --- + X^ 

converges weakly to a positive random variable. From this it follows that 



n 

converges to a positive constant, say Cq,. In fact, since (Logan et al. [5]) 
E{S^/V^) ^ 1 + a and obviously Eiy^f /V^ = 1, following the proof of 
theorem 3.3 of Gine et al. [1] and using the simpler symmetry assumption 
of ours, the constant Cq, can be shown to be equal to 1 — (a/2). Thus our 
proof of proposition 14.21 cannot be repeated along the same lines in this case 
although the necessary calculations for the finite dimensional distributions 
(corresponding characteristic functions) can be repeated following Logan et 
al. [S]. 
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